The Entropy Distance between the Wiener and Stationary Gaussian Measures
نویسندگان
چکیده
Investigating the entropy distance between the Wiener measure,Wt0,τ , and stationary Gaussian measures, Qt0,τ on the space of continuous functions C[t0 − τ, t0 + τ ], we show that in some cases this distance can essentially be computed. This is done by explicitly computing a related quantity which in effect is a valid approximation of the entropy distance, provided it is sufficiently small; this will be the case if τ/t0 is small. We prove that H(Wt0,τ , Qt0,τ ) > τ/2t0, and then show that τ/2t0 is essentially the typical case of such entropy distance, provided the mean and the variance of the stationary measures are set “appropriately”. Utilizing a similar technique, we estimate the entropy distance between the Ornstein-Uhlenbeck measure and other stationary Gaussian measures on C[1− τ, 1 + τ ]. Using this result combined with a variant of the triangle inequality for the entropy distance, which we devise, yields an upper bound on the entropy distance between stationary Gaussian measures which are absolutely continuous with respect to the Wiener measure.
منابع مشابه
Absolute Continuity between the Wiener and Stationary Gaussian Measures
It is known that the entropy distance between two Gaussian measures is finite if, and only if, they are absolutely continuous with respect to one another. Shepp [5] characterized the correlations corresponding to stationary Gaussian measures that are absolutely continuous with respect to the Wiener measure. By analyzing the entropy distance, we show that one of his conditions, involving the spe...
متن کاملAbsolute Continuity between the Wienerand Stationary Gaussian
It is known that the entropy distance between two Gauss-ian measures is nite if, and only if, they are absolutely continuous with respect to one another. Shepp (1966) characterized the correlations corresponding to stationary Gaussian measures that are absolutely continuous with respect to the Wiener measure. By analyzing the entropy distance, we show that one of his conditions, involving the s...
متن کاملThe Rate of Entropy for Gaussian Processes
In this paper, we show that in order to obtain the Tsallis entropy rate for stochastic processes, we can use the limit of conditional entropy, as it was done for the case of Shannon and Renyi entropy rates. Using that we can obtain Tsallis entropy rate for stationary Gaussian processes. Finally, we derive the relation between Renyi, Shannon and Tsallis entropy rates for stationary Gaussian proc...
متن کاملADK Entropy and ADK Entropy Rate in Irreducible- Aperiodic Markov Chain and Gaussian Processes
In this paper, the two parameter ADK entropy, as a generalized of Re'nyi entropy, is considered and some properties of it, are investigated. We will see that the ADK entropy for continuous random variables is invariant under a location and is not invariant under a scale transformation of the random variable. Furthermore, the joint ADK entropy, conditional ADK entropy, and chain rule of this ent...
متن کاملRobust Least-Squares Filtering With a Relative Entropy Constraint
We formulate a robust Wiener filtering problem for wide-sense stationary (WSS) Gaussian processes in the presence of modelling errors. It requires solving a minimax problem that consists of finding the best filter for the least-favorable statistical model within a neighborhood of the nominal model. The neighborhood is formed by models whose relative entropy with respect to the nominal model is ...
متن کامل